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ABSTRACT 

Sophisticated computer systems are being developed to assist 
in the human decision-making process for very complex tasks per- 
formed under stressful conditions. The human-computer interface is 
a critical factor in these systems. The human-computer interface 
should be simple and natural to use, require a minimal learning 
period, assist the user in accomplishing his task(s) with a minimum 
of distraction, present output in a form that best conveys informa- 
tion to the user, and reduce cognitive load for the user. In pursuit 
of this ideal, the Intelligent Multi-Media Interfaces project, spon- 
sored by the Defense Advanced Research Projects Agency and 
monitored by the Rome Air Development Center, is devoted to the 
development of interface technology that integrates speech, natural 
language text, graphics, and pointing gestures for human-computer 
dialogues. The objective of the project is to develop interface tech- 
nology that uses the media/modalities intelligently in a flexible, 
context-sensitive, and highly integrated manner modelled after the 
manner in which humans converse in simultaneous coordinated 
multiple modalities. As part of the project, a knowledge-based 
interface system, called CUBRICON (CUBRC Intelligent CONver- 
sationalist) is being developed as a research prototype. The applica- 
tion domain being used to drive the research is that of military tacti- 
cal air control. 


1. INTRODUCTION 

As the number and sophistication of military information pro- 
cessing systems rapidly increases, the impact on human operational 
users must be considered very carefully. Typically, large amounts 
of information must be communicated for use by the human opera- 
tor in performing time-critical decision-making tasks for command 
and control functions. The problem is to make such sophisticated 
systems easy for military operators to use quickly and efficiently. 
Modem information processing and decision-aiding systems require 
a full range of communication media to facilitate interaction and 
provide the increased bandwidth for information transfer with the 
human user. The human-computer interface must not only take 
advantage of multiple media/modalities, but must make use of the 
synergistic properties of these media to minimize the user’s cogni- 
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tive workload: (1) the human-computer interface system must pro- 
vide the user with input media/modalities that are natural and 
efficient for the user, and (2) the use of multiple media/modalities 
must be applied to the problem of presenting output information to 
the user in a manner that maximizes user comprehension; the 
manner of presentation must be based on knowledge of the applica- 
tion domain, the characteristics of the information, the discourse 
context, the user’s task, and respected human factors guidelines. 

Presently, there is no computer system that can meet the 
above requirements. Knowledge-based understanding and genera- 
tion of information by a computer system in multiple 
media/modalities has recently begun to be investigated [Neches & 
Kaczmarek, 1986; Kobsa et al., 1986; Arens et al., 1988; Neal & 
Shapiro, 1988; Neal et al., 1988; Sullivan & Tyler, 1988]. The 
research discussed in this paper is part of the Intelligent Multi- 
Media Interfaces (IMMI) project [Neal & Shapiro, 1988; Neal et al., 
1988] which is dedicated to the development of intelligent multi- 
media interface technology that integrates speech, natural language 
text, graphics, and pointing gestures for human-computer dialogues. 
The objective of the project is to develop interface technology that 
uses the media/modalities intelligently in a flexible, context- 
sensitive, and highly integrated manner modelled after the way in 
which humans converse in simultaneous coordinated multiple 
modalities. As part of the project, a knowledge-based interface sys- 
tem, called CUBRICON (the CUBRC Intelligent CONversational- 
ist), is being developed as a proof-of-concept prototype. Although 
the IMMI project is a basic research project, an application task 
domain of military tactical air control is being used to drive the 
research. 

This paper discusses the CUBRICON human-computer dialo- 
gue system and the multi-media communication methodology which 
forms the foundation of the system. Section 2 presents a brief over- 
view of the CUBRICON system. Section 3 discusses the 
knowledge sources used by the system. Section 4 focuses on multi- 
media input processing while Section 5 focuses on the generation of 
multi-media output. Subsequent sections outline the future direc- 
tion for the CUBRICON project, summarize the main ideas of this 
paper, provide acknowledgements, and list references. 


2. OVERVIEW 

The model upon which the CUBRICON system is based is 
that of two people talking in front of a blackboard or other graphics 
display device(s). People in such a situation use various combina- 
tions of modalities for very effective communication. The modali- 
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ties include spoken natural language, written text, pointing gestures, 
drawings, and tables. Thus, CUBRICON is intended to imitate, to a 
certain extent, the ability of humans to simultaneously accept input 
from different sensory devices (such as eyes and ears), and to simul- 
taneously produce output in different media (such as voice, pointing 
motions, and drawings). 

CUBRICON accepts input from three input devices: speech 
input device, keyboard, and mouse device pointing to objects on a 
graphics display. Output is produced for three output devices: 
color- graphics display, monochrome display, and speech output 
device. The CUBRICON software is implemented on a Symbolics 
Lisp Machine using the SNePS semantic network processing system 
[Shapiro, 1979; Shapiro & Rapaport, 1986], an ATN 
parser/generator [Shapiro, 1982] and Common Lisp. Speech recog- 
nition is handled by a Dragon Systems VoiceScribe 1000. Speech 
output is produced by a DECtalk speech production system. 

Every intelligent entity requires a considerable amount of 
knowledge upon which to base its decision-making processes. Cer- 
tain knowledge sources have been identified as essential to 
CUBRICON’s multi-media communication ability. These 
knowledge sources are discussed in the next section. 

3. KNOWLEDGE SOURCES 

In order for CUBRICON to perform the critical functions of a 
human-computer interface, the following knowledge sources were 
found to be essential: (1) domain-specific and related interface 
knowledge, (2) multi-media language knowledge, (3) the discourse 
context, (4) the user/task model, and (5) human factors guidelines 
for enhancing human understanding, and (6) information charac- 
teristics. 


3.1 Domain-Specific And Related Interface Knowledge 

CUBRICON includes a knowledge base containing domain- 
specific and interface information. The domain-specific information 
is applicable to the mission planning task domain of the target 
application system. Task domain entities include airbases, 
surface-to-air missile (SAM) systems, fuel storage facilities, and tar- 
gets. The knowledge base also includes essential information con- 
cerning how to present or express the various entities via the 
system’s verbal/graphic language. This information includes the 
words and symbols used to express any given entity, which which 
symbols are appropriate under which conditions, and when particu- 
lar colors are to be used. 


3.2 Multi-Media Language Knowledge 

CUBRICON ’s multi -media langauge is defined by the combi- 
nation of its lexicon and grammar. A lexicon is the collection of all 
morphines, tokens, or signals that carry meaning in a given 
language. CUBRICON ’s lexicon consists of words, graphic figures, 
and pointing signals. The grammar defines how the morphemes, 
tokens, and signals of the lexicon can combine to form legal com- 
posite language structures. An example of a multi-media language 
structure that is legal according to the CUBRICON grammar is a 
noun phrase consisting of the typical linguistic syntax, accompanied 
by one or more pointing signals (pointing to objects on a graphics 
display). 


3.3 The Discourse Model 

The attcntional discourse focus space [Grosz, 1978, 1986; 
Sidner, 1983; Grosz and Sidncr, 1985] is a key knowledge structure 
that supports continuity and relevance in dialogue. The CUBRI- 
CON system tracks the attcntional discourse focus space of the 
dialogue carried out in multi-media language and maintains a 
representation of the focus space in two structures: (1) a main focus 
list and (2) a set of ancillary focus lists called virtual displays. The 
main focus list includes those entities and propositions that have 
been explicitly expressed (by the user or by CUBRICON) via 
natural language, pointing, highlighting, or blinking. A virtual 
display is a list of all the objects that are "in focus" because they are 
visible in a given window on one of the displays. CUBRICON 
maintains one virtual display per window. 


3.4 User/Task Model 

A user/task model is essential as a basis for judging the 
relevance and importance of information items to the user. Car- 
berry [1987] provides a brief summary of current research on user 
modeling. CUBRICON’s user/task model includes (1) a task 
hierarchy and (2) an entity rating module. 

The task hierarchy is a decomposition of the user’s main tasks 
into subtasks. In a task oriented application system, there is usually 
some a priori knowledge of the task hierarchy and sequencing. Even 
though the task hierarchy structure is not absolute in that a user may 
deviate from the typical roadmap through the tasks, this hierarchy 
can be used as a valuable knowledge source to track the discourse 

focus, manage the displays, and anticipate the needs of the user. 

The CUBRICON entity rating module includes a task- 
dependent representation of the relative inportance of all the entity 
types known to the system and an algorithm for modifying these 
ratings depending on task and discourse context. CUBRICON uses 
a numerical value (on a scale from 0.0 to 1.0) to represent an 
entity’s importance. A pre-defined task-dependent initial assign- 
ment of ratings to entities is used when a new task is started by the 
user. These ratings are modified when the entities are referenced in 
the dialogue. 


3.5 Characteristics Of The Information 

The characteristics of the information to be expressed are criti- 
cal to the selection of an appropriate presentation modality. The 
following list briefly summarizes CUBRICON’s criteria for select- 
ing presentation modality based on characteristics of the informa- 
tion. The CUBRICON design is based on the premise that 
graphic/pictorial presentation is always desirable. 

o Color-graphics: Selected whenever CUBRICON knows how to 
represent the information pictorially. 

o Table: Selected when the values of common attribute(s) of 
several entities must be expressed. 

o Histogram: Selected when a quantitative attribute of several en- 
tities must be displayed in a comparative form. 

o Form: A predefined form is selected when the task engaged in 
by the user requires the form. 

o Printed natural language: Selected for the expression of a pro- 
position, relation, event, or combination thereof that would 
strain the user’s short term memory if speech were used (e.g., 
technical responses that must be referred to subsequently by the 


246 


user); the knowledge structures being expressed are heterogene- 
ous; 

o Spoken natural language: Selected for explanations of displays, 
verbal highlighting of objects on the displays, informing the 
user about the system’s activity (e.g., Tm still working” when 
the user must wait for output from the system), short expres- 
sions of relatively non-technical information that can be remem- 
bered when presented serially. 


3.6 Guidelines For Enhancing Human Understanding 

Guidelines from the human factors and psychology disciplines 
for enhancing human understanding are being incorporated into the 
CUBRICON system. Smith & Mosier [1986] provide one of the 
well-known sources of such human factors guidelines. Guidelines 
that have been incorporated in the CUBRICON system include: 

o Maintain the context of the user/computer dialogue. For exam- 
ple, in managing map displays, CUBRICON tries to retain the 
most recently discussed or mentioned objects on the displays 
(avoid premature removal) so as to maintain continuity in the 
dialogue. 

o Maintain consistency throughout a display. For example, when 
CUBRICON expands or extends a map display to include some 
new area, then the same types of objects are displayed in the 
new region as in the old so that the user does not incorrectly 
infer that a certain type of object is not in the newly added re- 
gion because it is not being displayed. 

o Maintain consistency across displays. Different displays of the 
same type should have the same general format. Color keys, ti- 
tles, help information, etc., should be consistently located for 
different displays of the same type. 


4. MULTI MEDIA INPUT UNDERSTANDING 

People commonly and naturally use coordinated simultaneous 
natural language (NL) and pointing gestures. These two modes of 
communication combine synergistically to form an efficient method 
of expressing definite references and locative adverbials. For exam- 
ple, a person could simply say ’’this SAM” (surface-to-air missile) 
and point to an entity on the display to select from among several 
SAM systems visible on the display. Used in isolation, each of the 
two modes have shortcomings. If natural language is used alone, 
then lengthy descriptions are frequently required to identify objects 
that lack unique ’’names". For example, to specify a particular 
SAM from among many SAMs visible on a map display, a person 
would need say something like "the SAM system at 12.3 degrees 
longitude and 50.5 degrees latitude" or "the SAM system just east 
of Kleinburg". 

Pointing used alone also has problems: (1) a point gesture can 
be ambiguous if the point touches the area where two or more 
graphical figures or icons overlap and (2) the user may inadvertently 
miss the object at which he intended to point. This latter problem 
is discussed briefly in the last paragraph of this section. To handle 
the first problem of ambiguous pointing, some systems use default 
techniques. These techniques include: (1) a point returns the entity 
represented by the "top" or "foremost" icon where the system has a 
data structure it uses to remember the order in which icons are 
"painted” on the display (i.e., which are further in the background 


and which arc foremost in the foreground); (2) the icons or entities 
are assigned weights representing importance and the icon with the 
largest weight is selected as the interpretation of an ambiguous 
point; or (3) the icon whose "center" is closest to the location 
pointed at is selected. Combinations of such techniques can also be 
used. A serious disadvantage of the above listed point- 
interpretation techniques is that it is difficult, if not impossible, for 
certain icons to be selected via a point reference. 

CUBRICON ’s acceptance of dual-media input (NL accom- 
panied by coordinated pointing gestures) overcomes the limitations 
of the above weak default techniques and provides an efficient 
expressive referencing capability. The CUBRICON methodology 
for handling dual-media input is a decision-making process that 
depends on a variety of factors such as the types of candidate 
objects being referenced, their properties } the sentential context , and 
the constraints on the participants or fillers of the semantic case 
frame for the verb of any given sentence. CUBRICON’s decision- 
making process draws upon it’s knowledge sources discussed in 
Section 3. 

CUBRICON also provides the user with flexibility in several 
different ways: (1) the user can input natural language via either the 
speech device or the keyboard, (2) the user is not limited to just one 
point per NL phrase, but can point several times per phrase, (3) 
point gestures can occur anywhere within a given NL phrase, and 
(4) the user can reference four different types of objects via point- 
ing: geometric points, entities represented graphically (e.g., by 
icons), entries in table displays, and windows on a display. 

We present a few brief examples to illustrate the functionality 
of the system. In each of the following examples, assume that the 
<point> touches one or more icons. 

Example 1: USER: "What is the status of this <point> airbase?" 

From the icons touched by the point, the virtual display is searched 
for the semantic representation of the objects which were graphi- 
cally displayed by the touched icons. From the hierarchy of the 
knowledge base, the system determines which of the objects 
selected by the point gesture are airbases and discards the others. 

Example 2: USER: "What is the mobility of this <point> ?" 

Example 2 entails the use of the property "mobility" as the critical 
item of information that is used to determine the referent of the 
dual-media phrase. After searching the virtual display for the 
objects touched by the point gesture, CUBRICON determines which 
of these objects have property "mobility" using the knowledge base 
of application information. 

Example 3: USER: "Remove this window <point>." 

In example 3, assuming the <point> touches an icon on a window 
of the display, the term "window" used with the point gesture 
insures that the system correctly interprets the reference, which 
would otherwise be ambiguous. 

CUBRICON also includes the ability to handle two types of 
"ill-formed" input: dual-media expressions which (1) are incon- 
sistent or (2) have an apparent null referent. A dual-media expres- 
sion is inconsistent when the natural language part of the expression 
and the accompanying point cannot be interpreted as referring to the 
same objects) (e.g., the user says "this airbase" and points to a fac- 
tory). A dual-media expression has no apparent referent when the 
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user’s point touches no icons (i.c. he points to an "empty" area). In 
both of these eases, CUBRICON infers the intended referent. The 
CUBRICON methodology for processing multi-media input is dis- 
cussed in greater detail in [Neal et al., 1988]. 


5. MULTI MEDIA OUTPUT GENERATION 

The CUBRICON system is being developed so that it embo- 
dies the following key features which are essential to maximizing 
human understanding of presented information: (1) Output presenta- 
tions should be sensitive to context and relevance. (2) Selection of 
appropriate presentation media/modalities should be based on the 
characterisitics of the information to be expressed, alternatives 
being selected when necessary. (3) The media/modalitics should be 
used in a highly integrated manner during output presentation. (4) 
Respected human factors guidelines should be adhered to. 

The CUBRICON output planning process is highly dependent 
on the knowledge sources discussed in Section 3. The top level out- 
put planning process is summarized below. 

1. For each information item or cluster, determine the modality in 
which it should ideally be expressed. Graphic/pictorial presen- 
tation is always desirable. Natural language can always be used 
as a last resort. 

2. Determine whether the resources are available to express the in- 
formation as desired. Resources: (1) Color graphics display: 
Are the items to be expressed graphically already on the 
display? If so, no additions are necessary. If not, is there room 
to insert them in their "natural" position? (2) Monochrome 
display: Similar to the color graphics display. (3) Natural 
language text window: Always available due to scrolling capa- 
bility. (4) Speech output device: Always available. 

3. If the desired display cannot accommodate the new information 
without modification, determine whether the state of the display 
can be modified. This depends on the level of importance of the 
information to be expressed and the task model. 


Possible modificatioas to the graphics display: 

o Extend the displayed region to include information 
items to be expressed. 

o "Zoom in" to display a portion of the current display in 
greater detail. 

o "Pan" to a different region, 
o Combination of the above. 

o Open a window on the display to show the new infor- 
mation. 

4. If the display status cannot be adequately modified as per step 3 
above, try modifying the information to be expressed: trim the 
amount of information by filtering on die basis of relevance 
with regard to the user/task model and/or the discourse model. 

5. If the information can still not be expressed in the given modali- 
ty due to insufficient resources for the selected modality, then 
select another modality and go back to step 2. 

6. Finish composing the output having resolved resource restraints. 

The following are working examples from a dialogue with 
CUBRICON to illustrate the functionality of the system. These 
examples illustrate the output composition process and use of the 
knowledge sources discussed in the previous sections. The dialo- 
gues are concerned with mission planning and situation assessment 
in a tactical air control domain. 

USER: "Display the Inner Fulda Gap Region." 

CUBRICON: 

Color Graphics Display: 

o Map of Inner Fulda Gap Region with main roads, major cities, 
waterways, and national boundries (Figure 1). 

o Icons representing entities within the Inner Fulda Gap Region 
that are above a preset threshold in importance superimposed 
on the map (Figure 1). 




Figure 1. Multi-Modal Presentation Composed by CUBRICON 
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Monochrome Graphics Display: 

o Table of relevant attributes for the entities that arc displayed 
on the map display. 

DISCUSSION: 

CUBRICON’s first choice for displaying information is graph- 
ically, when appropriate. The Fulda Gap Region boundary is 
defined in the CUBRICON knowledge base and provides sufficient 
information for the modality selection process. CUBRICON selects 
color- graphics as a display modality and generates a map display. 
Since this was the initial input, the color graphics display was avail- 
able. 

An important feature of CUBRICON is that output presenta- 
tions are formulated in a context sensitive manner. Entities to be 
displayed on the map are selected on the basis of their importance 
to the task at hand. Only entities above a pre-set threshold on the 
entity rating scale are displayed. Non-domain-specific items such as 
national borders, roads, rivers, and cities are displayed using the 
MAP Display System [Hilton, 1987J. 

Another key feature of the CUBRICON interface system is 
that it is multi-media. In the present example, the CUBRICON out- 
put uses both color graphics (i.e., the map display), and a tabular 
presentation on the monochrome display. The tabular presentation 
was selected because there are important attributes associated with 
the entities displayed on the map display, which would severely 
clutter the map if included there. 

USER: "Where is the Dresden airbase?" 

CUBRICON: 

Color Graphics Display: 

o Map of Inner Fulda Gap Region with added area that includes 
the Dresden airbase (Figure 2). 


o Main roads, major cities, waterways, and national boundrics 
(as before but across the whole map, old and new areas) (Fig- 
ure 2). 

o Icons representing entities within the map area displayed that 
are above a pre-set threshold in importance are superimposed 
on the map (same as before but across the whole map, old and 
new areas) (Figure 2). 

o An airbase icon labelled "Dresden Airbase". This airbase icon 
is displayed as initially blinking and then highlighted. 

Monochrome Graphics Display: 

o Table of relevant entity attributes. Same table as before, but 
expanded to include new entities added to the map (Figure 2). 
The Dresden Airbase table entry (row) is highlighted. 

DISCUSSION: 

The information requested is location. The Dresden airbase 
has an icon representation and a longitude, latitude associated with 
it in the CUBRICON knowledge base. The preferred modality for 
presentation is therefore graphical. 

In composing a new map on which to display the Dresden air- 
base, the system has some choices. These include: open a window 
on the color-graphics display showing the area around the Dresden 
airbase, replace the old map on the CRT with a new area around the 
airbase, or compose a new map including both the old map and the 
region around the Dresden airbase. 

An important principle that CUBRICON tries to follow is to 
preserve the context of the human-computer dialogue. Since the 
user task has not changed and there is already a map displayed on 
the color graphics display, the system expands the displayed area to 
include the Dresden airbase. CUBRICON selects this option 
because it provides the requested information while it preserves the 
display context. When the Dresden airbase is added to the map, the 
system also blinks it as the system’s way of "pointing" to the object 
under discussion. 




Figure 2. Map and Table Maintaining Context and Consistency 
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Another important guideline to which the CUBRICON system 
adheres is to maintain consistency throughout a display so as to 
prevent the user from making false inferences about what is or is 
not located within the region. In the case of our map display, this 
means that there should be consistency in the types of objects 
shown across the entire map. If SAMs are displayed in the old 
region, then they should be displayed in the newly added map area. 
Similarly for other types of objects. If this is not done, then the 
user might incorrectly infer that there were no SAMs in the new 
area. Guided by the consistency principle, the system also modifies 
the tabular presentation that is on the monochrome display. The 
new displays are shown in Figure 2. 


USER: "What is the mobility of this SAM (accompanied by a 
point gesture to a SAM with the mouse device)?" 

CUBRICON: 

Spoken and Written Natural Language: 

o "The mobility of this SA-3 is high.” The phrase "this SA-3" is 
accompanied by blinking the particular icon as the system’s 
means of pointing to it. 

DISCUSSION: 

CUBRICON selects natural language as the modality as per 
the criteria presented in Section 3.5. This example also demon- 
strates CUBRICON’s ability to generate multi-media output that is 
highly integrated. Specifically, in this example, the spoken natural 
language definite reference "this SA-3" is coordinated with a blink- 
ing reference on the graphics display. 

USER: "What are the mobilities of these <pointl> 
<point2xpoint3xpoint4xpoint5>?" The five pointing 
gestures indicate five different SAM icons on the color map 
display. 

CUBRICON: 

o Color-Graphics Display: The referenced SAMs are 

highlighted. 

o Monochrome Display: A window containing a table display- 
ing the mobilities of the indicated SAMs is added. 
DISCUSSION: 

The user's question is almost the same in these last two exam- 
ples. CUBRICON responds in coordinated NL and pointing when 
the response is a single proposition, as in the previous example. 
However, CUBRICON selects a table modality with associated 
highlighting on the color-graphics display for this last response. 
This selection is made since the values of a common attribute 
(mobility) of several entities must be expressed. This situation 
matches the selection criteria for the table modality as presented in 
Section 3.5. 


6. CURRENT STATUS AND FUTURE DIRECTION 

The work discussed in this paper has been implemented on the 
hardware suite described in Section 2. The knowledge sources dis- 
cussed in Section 3 have been implemented and the functionality 


described in this paper has been realized in the current CUBRICON 
prototype. The examples presented in Sections 4 and 5 arc working 
examples. 

The CUBRICON team is continuing its research and develop- 
ment of the concepts and methodology essential to intelligent 
multi-media human-computer interface systems. This includes con- 
tinued research and development of the knowledge sources such as 
the user/task model and discourse model, the automated process of 
determining the appropriate media/modalities for any given infor- 
mation items or clusters, appropriate modification of the displays 
including placement of information when needed, the multi-modal 
composition process, and the role of speech output in a multi-modal 
interface system. 


7. SUMMARY 

Modem information processing and decision-aiding systems 
are complex and require a lull range of communication media to 
facilitate interaction and provide the increased bandwidth for infor- 
mation transfer with the human user. The human-computer inter- 
face must be able to use and manage the media and modalities in an 
intelligent manner. The Intelligent Multi-Media Interface Project is 
devoted to the development of interface technology that integrates 
speech, natural language text, graphics, and pointing gestures for 
human-computer dialogues. The objective of the project is to 
develop interface technology that uses the media/modalities intelli- 
gently in a flexible, context-sensitive, and highly integrated manner 
modelled after the manner in which humans converse in simultane- 
ous coordinated multiple modalities. As part of the project, a 
knowledge-based interface system, called CUBRICON is being 
developed as a research prototype. Several knowledge sources are 
essential to intelligent use of multiple modalities and are included in 
our CUBRICON system: a knowledge base of application-specific 
and related interface knowledge, a definition of the multi-media 
language in the form of a lexicon and grammar, a discourse model, 
a user/task model, knowledge of information characteristics and the 
appropriate corresponding modality for expressing the information, 
and human factors guidelines for enhancing human understanding 
and reducing cognitive workload. CUBRICON accepts dual-media 
input consisting of natural language and simultaneous coordinated 
pointing gestures. The CUBRICON methodology handles the syn- 
ergistic mutual disambiguation of simultaneous natural language 
and pointing as well as inconsistent NL/pointing expressions and 
expressions that have an apparent null referent. CUBRICON's out- 
put composition process includes selection of appropriate modalites 
and media, determination of whether resources are available, subse- 
quent modification of resources or modification of the information 
to be expressed (if necessary), modification of selected output 
media/modalities (if necessary), and composition of the output. 
Examples were presented to illustrate some of the key functionality 
of the CUBRICON system. 
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